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ABSTRACT 

Recognition of polyhedra by a heterarchical program is presented, The 
program is based on the strategy of recognizing objects step by step, 
at each time making use of the previous results. At each stage, the 
most obvious and simple assumption is made and the assumption is tested. 
To find a line segment, a range of search is proposed. Once a line seg- 
ment is found, more of the line is determined by tracking along it. When- 
ever a new fact is found, the program tries to reinterpret the scene taking 
the obtained information into consideration. Results of the experiment 
using an image dissector are satisfactory for scenes containing a few 
blocks and wedges. Some limitations of the present program and proposals 
for future developments are described. 
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1. INTRCIXJCIIOrc 

We do not know how to make a program to recognize objects visually 
sb well as a human being. One of the shortcomings of many computer 
programs is* as fcinsky has pointed out , their hierarchical structure, A 
human may recognize objects in the context of the environment. The 
environment may he recognized based on his a priori knowledge. The 
recognition rrocoduro is, however, well programmed so that the simple 
cbvious parts are recognized first and the recognition proceeds to the 
more complicated details based on the previous results. 

The work in this paper studies an example of a heterarchical program 
to recognize polyhedra with an ima^e dissector* Most previous works 
legin by trying to find feature points in a entire scene and make a 
complete line drawing. It is very difficult to ret a complete line 
drawing without knowledge about a scene. If the line drawing has some 
errors, the recognition by a theory besed on the assumption of the 
complete line drawing such as Guzman's might make still more serious 
mistakes. Our work is an attempt to recognize objects step by step, at 
each time making use of the previous results. 

We assume in this paper that the difference in brightness- between 
cb^ects and the background is large enough to detect the boundary 
approximately. At present, this program works for recognizing 

moderately complicated configurations of blocks and wedges. Th^ 

limitations and proposals for future development are described later. 



FACE 2 



2, GENERAL STRATEGY 

2*1 Priority Of Processing 

For convenience, we define the ed^es of the objects in a scene as 
falling into 3 classes, A line formed at the boundary between the bodies 
end the cuter background is a contour line of the bodies. In Fig*1 f 
lines Ah, *C f &) f DE, EF t FG, GH, HI, U f JK, XL, Lh, MH, N0 f AO, Vtf- UX, 
*Y, YZ and ZV are contour lines. A boundary line is a line en the border 
of an ob^ct. Contour lines are boundary lines. In Fir- 1 * the boundary 
lines are the contour lines ajid lines on the boundary between two bodies, 
i.e. CP, PK, IQ, Q!?, and Rl!. An internal line occurs at the intersection 
of two planes of the same body. Lines J£, L5, QE, FT, NT, AT, Ft, OU, DC 
and XV are internal lines. 

The ^lolal strategy is shown in Fig. 2. At first, the contour lines 
are extracted (because we assume a priori enough contrast between the 
objects End the l-ackfround). If more than one contour is found, as in 
Jig.1, one contour for todies E1, £2, 15 and another for lody B4, then 
the boundary lines and internal lines are searched one by one for each: 
contour. The global strategy in block 2 in Fi£.2 is as follows. 
A) Find boundary lines before finding internal lines because boundary 

lines often /live £OOd cues to £ues& Internal lines. Kote that to find 

boundary lines iaplies to find bodies. 
E) In searching for linen, different situations require examination of 

lar^r or smaller areas. In our strategy, the smaller the area 

required to search lines, the hifher priority we give to that search. 
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In Fig-1, for instance, tc determine the existence of a extension of 
line 1C» it is enough to search a small area whose center is on the 
extension cf the line. To find line IQ f however, we should consider 
all possible directions of a line between IP and IJ* Thus the former 
search has priority over the latter 

The priority to extract the most obvious information first is the 
following order. 

{ 1} If two boundary lines make a concave point (such as point E in 
Fig«3)i try to find the extension of them. If only one extension is 
found, track alone this line. Most of such cases are like in Fig. 3 
(b) where one body hides the other- Vie can determine to which side 
of bedy this line belongs. 
( 2) If no extensions of two concave lines are found, try to find another 
line which starts from the concave point. If only one line is found, 
track along this line- host of these cases are as in Fig. 3 (c) where 
it is not clear locally to which body this line belongs. In Fig. 3 
(c) f line BD belongs to the upper body* but this is not always true. 
That is the lines AB, BC, BD are not sufficient to decide the 
relation. 
( 3) If fcoth extensions cf two lines are found at a concave point, try to 
find a third one. If only one line is found, track along this line. 
This is the case as shewn in Fig. 3 (d) where the third line is the 
boundary line. 
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Whenever tracking terminates , an attempt is always made to connect 
the new line to the other lines that were already found. If more than 
one line secant is found in (1), (2) or (3), the tracking of those lines 
is put off hopefully to be clarified by the results of knowledge obtained 
in simpler cases. FiG-4 illustrates two extensions found at concave 
point P. The interpretation of the two lines is put off to treat simpler 
cases first. That is, one would continue examining the contour end lines 
AB and cr mifht te found next; then, by a circular search at joints B 
(which is explained later), line BP would be found. At this sta/^e it is 
easier to interpret lines AE and BP as koundary lines which separate two 
bodies- Then line DP r.ight be found similarly and interpreted 

correctly. 

(4) If an end of a boundary line is left unconnected as PQ in Fl£.5 f try 

to find the line starting from the end point (C in this example) by 

circular search. If multiple lines are found, try to decide which 

line is the boundary. If a boundary line is determined, track alonf 

it. In Fig-5, the dotted lines are found by circular search and the 

arrows show the boundary lines to be tracked. 

( 5) If no line is found in the case (4) as stated above, extend the line 

(FQ in this example) by a certain length and test if the line is 

conected to other lines. If not, then apply circular search a^ain as 

in (*!). This is necessary because the termination point of the 

tracking is not always precise. 

Note that this process can be repeated until successful {that is 

either the line is connected to other lines or line cedents are found by 
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circular search)* 

( 6) If the boundary lines cf a body are known, select the vertices of 
the boundary that miftht have internal lines starting at then. The 
selection of vertices is based on heuristics such as seletin* upper 
right vertex rather than lower right vertex. At each vertex, try tc 
find an internal line which is nearly parallel to other boundary 
lines- If one line is found, track along it. In xig.l, for 

example, internal line J£ is parallel to the boundary line KL or IQ, 
and CS is parallel tc Rl or IJ. Line FU is parallel to ED and XV is 
parallel to XZ. Thus it is often useful to find internal lines 
parallel to boundary lines of the same body. Note that search for 
parallels has snail area. 

( 7) If no line is found in (6), try to find one by circular search 
between adjacent boundary lines. When one line is found, track alonf 
it. In lig.C, circular search between BA and BC is necessary to find 
the internal line BE. 

( 8) If two internal lines meet at a vertex, try to find another internal 
line starting at the vertex. This process is used in tve cases. One 
is where no internal line was found in (7) because of little 
difference in brightness between adjacent faces. Suppose in Fi£*1* 
that the internal line £J was not found at vertex J» but thnt 1£ and 
QS were found. Then try tc find an internal line starting at ? 
toward J. If there is enough contrast near E f a line sequent is 
found. The other esse is where a body is partly hidden by other 

bodies. In Fir*5» the triangular prisrc is partly hidden. After EI" 
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and CE are found, EF is searched for. In both cases, the direction 
of the line is sometimes predictable and sometimes not. If it is 
predictable, then try that direction. If it is unpredictable or if 
the predicted direction failed, then apply circular search between 
the two internal lines. If one line is found, track along it. 

( 9) If en end of an internal line is not connected to any line, try to 
find lines starting from the end by circular search. If lines are 
found, track alon# them one by one. 

(10) If no line is found in (9). extend the line by a certain length as 
in (^) and test if it is connected to other lines, if not connected, 
try circular search again as (9)- This process can also be repeated 
until successful- Fig. 7 illustrates this process. In ?if.7 (a), 
line MN* is not connected to others at ?!*, thus step (9) is tried at 
K* and fails. The line is extended to F| and (2) is again applied. 
This process is repeated until the line is connected to line XL at N. 
Fig. 7 (b) shows that line HI is extended by this process to p i where 
a new line is found by circular search. Similarly line CG is 
extended to Pf« This process is useful so as to not miss a new body 
sitting on an otecure edf*e. 

At each sta^e when an above step is finished, the obtained 
information is interpreted as shown in Pig* 2 (block 3). For instance, if 
tracking along a line terminates, a test is made whether the line is an 
extension of other lines and/or the line is connected to other lines at a 
vertex. If a boundary line is connected to another boundary line, the 
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tody havinc the lines Is split into two todies and the properties of both 
lines and vertices are stored in an appropriate structure. In Fig.S, for 
exajarle, line N'P' is obtained by tracking starting at point N* This line 
is interpreted as an extension of H*I 9 and HN and N'P* are merged into one 
straight line using the equations of these two lines* Then, it is 
connected to CO and Fig.6 (b) is obtained. Before the line was connected 
to CO, there were two bedies B1 and B2 as in Fi#.3 (a). How body E2 is 
split into two bodies E2 and E3. We can interpret line NO as the 
boundary of B3 which hides a part of B2. The other properties of lines 
end vertices are obtained similarly at this staee. 

2.2 Example 

We illustrate the entire line-finding procedure with the aid of the 
example shown in Fig. 9. At first, the contour lines AB, EC, CL", DE, EF, 
Kj, 0H f i I, IJ» JK and KA are obtained as shown in Fig.9 (a)* Step (1) 
described in the previous section is tried for the concave points G and 
J. In this example, the position of G is not precise enough to find the 
extension of PC. Cn the other hand, a line segment is found as an 
extension of the line KJ. KJ is extended by tracking as far as L. 
Localise there is no ether point to which step (1) is applicable, ster (2) 
is tried for point G. One line segment is found and extended till 
tracking terminates. Thus a line G'J:* is obtained as in Flg*9 ( fc J* This 
line is interpreted as an extension of FG and connected to JL. Then the 
position of joint F, G, L are adjusted to as shown in Fif.9 (c). How two 
todies 11 and B2 are? created by the boundary lines GL and JL. It is 
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important tc notice this, for it means that step 0) is again applicable 
(to point L) at this sta^e. Thus line FL is extended as far as W in 
Hg-9 (d) (Note that line MS" has not yet been fcund). LK is interpreted 
as an extension of FL but the end point M is not connected to eny ether 
lines. Thus vertices F, C» L and end point H are adjusted considering 

the new line LM« Here neither stef (1), (2) nor (3) is applicable, so 
that (4) is row applied to H. Three lines are found by circular search as 
FiC*9 (d)* KIJ* is determined as a boundary line snd extended by 
tracking. 1,'hen it terminates, the line is connected to boundary line BC 
at vertex N es in Fir* 9 (*)• Body £1 splits into body F1 And B3* It is 
known at this sts^e that B1 is hidden by B3 and F2 is hidden by partly E3 
and partly by B1. Keact, step (6) is applied to each body one by one at 
each tine selecting the easiest body for proposing the internal lines(in 
this exairple, the order is 13* E1 f B2 because fc3 hides B1 which hides 
E2). Internal lines CO and KO are found and connected at vertex f but 
no line segment is found using step (6) and (7) applied to vertex E (this 
stage is shown in Fig»9 (ej). Step (3) is applied to vertex and a line 
sequent toward E is found. This is extended by tracking as far as F* as 
in Pig.S (f)* Line OK* fails to be connected to any other lines which 
activates step (10). After a few trials, OF* is extended to connect to 
vertex E. Similarly, internal line Al. is obtained for body E1 and lino IF 
is obtained for 1.2. When every step has finished, three bodies rre known 
toother with the relationships between them. 
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3. ALGORITHMS 

This section describes the details of the algorithos that are used 
in finding contours and in the steps stated in section 2* Sorae of then, 
such as tracking and circular search are used in more than one step* An 
algorithm used in more than one ster may be slightly different in each 
step but its essential part is not changed. In the tracking algorithm, 
for example, some changes occur dep*>ndinf on whether tracking is used for 
boundary lines or internal lines. 

3*1 Contour Finding 

Fig* 10 shows the outline of the procedure to find contour lines* 
Qhe picture data obtained with an iaage dissector usually consists of a 
large number of points (say about 1CC.0O0) each of which represents light 
intensity level* Tc speed up the processing, one point for every S x S 
joints is sampled. This compressec picture data consists of 1/54 the 
number oi points in the original picture. To find the contour, this data 
is scanned till a contour point is found. The judgment of contour point 
is based upon the simple assumption that there is enough contrast between 
the background and objects* It is then checked whether or not the point 
is a ncise point* If it is a real contour point, trace slonf the 
contour* Thus a s^t oi contour points are found. Then, the picture 

data is again scanned until a new contour point is found. This process 
is repeated for all the picture data. When all the sets of contour 
points have been found, each set is separately analysed* 
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Suppose a certain set of contour points is to be analysed. tfe now 
return to the original hisft-resolution picture. We can fuess 

approximately the position of the boundary point in the oririnai picture 
data which corresponds to the first point found in the sampled picture. 
She precise boundary point is searched for near this point. A set of 
contour points is obtained by tracing frora this point in the saoe way as 
in the sample picture. A polygon is formed after we connect contour 
points one by one. To classify the points of this 'curve* into foments, 
the 'curvature' of the polygon is used. This curvature in a digital 
licture is defined h^re for convenience as shown in Fig.11. Each cell in 
the figure represents a contour point. The curvature of a point P is 
defined to be the difference in an#le between PR and PQ (c<), where Q and 
P are a constant nunber of points away from P (6 points in this esse). 
Jf we plot the curvature along the contour as shown in Fif.12, we car* 
tell what part is near a vertex and what part lies in a straight line. 

Note that curvature is not very sensitive to noise or digitization 
error* If we integrate the curvature in part of a straight line, the 
result is nearly zero despite the effect of noise. If we sun up the 
curvature of consecutive points whose absolute value is preater than some 
threshold, we can determine the existence of a vertex. That is if this 
sun of the curvature of such points exceeds a certain threshold, there is 
a vertex near these points. Thus every contour point is classified to be 
either in the straight part of a line cr near a vertex. Using points 
which belong to the straight part of a line, the equation of the line is 
calculated. "hen each vertex is decided as an intersection of two 
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ciljaccnt lines. 

3*2 Line segment Detection 

A line Sequent is detected given its direction and starting point* 
This procedure is used in mest of the steps steted in section 1- The 
procedure consists of two parts. One is to detect the possible feature 
points which are to be regarded as elements of the line. The other is to 
test whether or not obtained feature points cake a line sentient. 

In detecting featurr joints, we should consider various types of 
edfies- Herskovits and tinford classified the liftfit intensity profiles 
rcross en edge into 3 types, namely step, roof and edge-effect, an<i 
proposed 3 types of boundary detectors- In this paper, a roof type 
detector is not considered because roof type edees can be detected by a 
step detector or an edge-effect detector- In addition, most roof type 
edges are accompanied by step or edge-effect types- We set up local 
Cartesian coordinates U-V such that U is the direction of the line 
secraent to be detected* Let I(u»v) denote the li^ht intensity at point 

(u,v), and define the contrast function Fiv(v) at (u,v) as 

F*(v) - Ji fe (Ku + Uv + j)-I(u + i,v - j) ) 

Suppose we have on intensity profile as shown in Fif-13 (a), xV(v) at ? 
in Fitf-13 (b) is the difference of summed intensity between area A z and 
A|# *W(v) f °r a typical step type profile (Fi£.13 (a)) is shown in 

Pi/% 13 (c) in which the edje is detected as the pe?k. The typical 
frofiles of I\(v) for other types arc shown in Fig. 14 where the ed?e is 
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detected as the Kiddle point between positive and negative peaks. 

The basic procedure, therefore, is to detect the jeak of I^{w) and 
its josition. Ihe necessary properties for a yeak are as follows (see 
Pig. 15). 

(a) If fti(v) ranges from v^ to Vy* , there must exist the maximum of 

*V(v) at V-*, other than v^ or v^. 
(bj ?*(v m ) > f* where f* is threshold 

(c) There rust exist a minimum of P^(v) at v^ between v* and v^ and a 

niniaai of i\(v) at v 2 letween v^ and v^ such that 

F a (v m ) - F*(v,) > f<C 

^V(v w ) - *V(v z ) > fx where f* is a threshold 

If such v^ is found, the left of the peak (vj) and the ri^ht of the 
peak (v^) are determined as the intersection of F^(v) with the line t^(v) 
= ft as shown in Fig. 15. The value of fj depends on ^(v^) and is 
represented as 

ft = c i F *(v*) + c 

where c, and c are constant and 0<Cj < 1 t c >0 
Ihe position of the peak v is obtained as the middle of v^ and v^. If 
nore than one peak is found between v# and v^. , the pcint Vp which is 
nearest to the middle of v# and v r is adopted. A negative pesk is 
similarly detected. A feature point for an edgeveffect or roof is 
obtained as the middle cf the positive and negative peaks, if both are 
found, (although the threshold f M is not the same as in the sample 
positive or ne^stive peak detection). This method for the detection of 
peaks and positions is net appreciably affected by noise. 
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The other part of the line segment detection is a test of the co- 
linearity for the detected feature points. Suppose concave boundary 
lines L& and L( meet at P^and suppose the line segment extending Lp is 
tested as shown in Fig. 10* Feature points are detected in a rectangular 
search area vith given length and width whose direction is equal to that 
of L (= C), at an appropriate place where the detection of feature points 
is not affected by the edge corresponding to Lj . Feature points arc 
detected along the direction v at the center points P r ,P, *..**P 1 n 
sequentially* If rositive peaks are found at tti,M if -*.*K^ as shown in 

the figure, the linearity of the points are tested as follows* 

(a) The number of the feature points must exceed a threshold number n . 

(b) The deviation 4* of the points in line fitting with the least 
square rrethed should be less than a threshold 6\ * 

(cj let I* denote the direction of line segment obtained by line 
fitting, 
|U' - U| < U* 
where llT - Ul denotes the diffrence in directions U* and U 



Similar tests are made for the different types of feature points* 
3f more than one type of line segment is found, the selection depends on 
the following criteria* 

(a) If an edge-effect type is foun<! f then it is selected* 

(b) For the line segment with & x aaid U*. let the criterion 
function C be 

C = <t x + w rt |U' - U| where w is a constant 
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The line segment selectee is the one wiht smaller C. 

3-3 Circular Search 

Circular search is used to senrch for lines starting at a fiver 
joint. The direction of the lines to be searched for is not known. The 
range of directions in circular search depends upon the particular case. 
Suppose two known lines Li and L^ fleet at P as in Fif. 17 (a) and suppose 
ve wish to search for lines lyin£ between them. The search ran^e c^ is 
between two lines h\ and L^ whose directions are slightly inside of Li 
and Lx respectively* If lines starting at jx>int P of line L© are 
searched for as in Fi/%17 (b) # L^ and L^are similarly set inside of Lp* 

The center point I of the circular search is not alwsys precisely 
determined, especially when tracking along a line has terminated at point 
T as shown in Fi£.17 (b). Therefore circular search should not be too 
sensitive to the position of the center joint- 
It might be natural to try to detect feature points, as defined in 
section 3*2, based upon F^(v) along arcs around the center- The 
difficulty with this search is the classification of feature points intc 
line segments if there is more than one as shown in Fif. 1G. To avoid 
this difficulty, a simple algorithm is used in this £©per. Its basic 
method is to apply line segment detection successively in various 
directions. Ibis is illustrated in Fie* 19, where successive line 

sesment detections toward U| ,ui and uj fire applied- The step of 
ciroctior change and search area (A|*Ai and A^ in the figure) are 
d^ternined so that line segments of any direction near the center point 
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can be found. Thus successive circular search along a line as shown in 
Fig. 7 can find lines starting at points between two adjacent center 
points (<?.g. line L in Pig.2C starting between P ( and P 2 J. The algorithm 
for line setraent detection is the carae as described in 3*2 except with 
respect to thresholds and search area. Because the search areas for 
different directions overlap eech other, the same line segment aay be 
found in different searches. Each time a line segment is found by line 
segment detection, a check should be made whether or not it is the sane 
ps the one obtained by the previous detection. 

If the center point of circular search has not been determined 
precisely, it is not always possible to find all the lines starting at 
the cive* 1 point- In Fig. 21, for example, line L z night be missed in 
circular search at Fo- To avoid this inconvenience, when line segments 
are found (such as Li and L3 in the figure), a new center point ?j is 
calculated tased on the known line (Lp) and the obtained line segments 
(Li and L3). Then circular search is applied a^ain at F t . 

3*4 Tracking 

Tracking is used when a line segment is given, to track along it 
until it terminates. Ihe requirements for a tracking procedure are 1) 
the line should not be lost due to the effect of other lines or noise, 
end 2) the procedure should terminate as precisely as possible at the end 
of the line. These requirements are contradictory in that the 

tnrmination concition should be strict to satisfy the second requirement 
which makes it difficult to satisfy the first. The following ©lcorithrc 
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is a comjromise tetween these requirements* 

The basic procedure is to predict the location of a feature joint 
and to search for it near the point using line segment detection. The 
result of the sesrch is classified into the following A cases. 

(a) there is no feature point. 

(b) a feature point is on the line. 

(c) A feature point is not on the line. 

(d) It is not clear whether or not a feature point is on the line. 

In case (a) f the detection of a feature point is similar to line 
segment dn taction except that the type of edj^e is already known no that 
the thresholds stated in 3*2 can be adjusted based on the average peak of 
l H (v), The decision between cases (b) f (c) and (d) is rarde r-sin£ the 
distance d between the point and the line. That is 
If d < d| then case (b) 

If d > d z then case (c) 

If d,< d < d t then case (dj 

The threshold d ( changes depending en the state of tracking. The 
state of tracking is represented by two interers in B and rc a which are set 
initially to 0. The value of ra and m are chanced for each case (a), 
(b) f (c) and (d) as follows, 
(a) m | = JQ[ + 1 
(bj If rij > o lf Bj = tt| - 1 , (where m is a constant) 

Otlerwise, m, =0, w x = 0, and classify those feature points 

into (b) which hpve teen clasified into case (d) 
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in the previous steps of tracking* Adjust the 
equation of the line with these joints and the 
present feature [oint 

(c) If d < dj and m. > m^.* m* = m. — 1 

(where d is a constant) 
Otherwise no change 

(d) m z = zg^ + 1 f and if ei,> m^ f m^= m.- 1 

The threshold dj is represented as 

di = d^ + w^ m 1 (where d and w^ are constants) 
Ihis procedure is repeated and tracking proceeds step by step 
extending the line until the termination condition is satisfied* 
Ihe termination condition of tracking is either 

m { > m n or n ( + m x > m t (where a M and n t are constants) 
lhe terminal point is defined as the last point classified into case (b). 
lig.22 illustrates hew this algorith works* In Fig.22 (a)* two lines 
cross at P * bracking might finish at sooe point teyond P<> (P*^ in the 
figure) which satisfies the termination condition. The terminal point of 
tracking is, however determired more precisely near Pq(?\ cr P a ). In 
IiC-22 (b), Pj $ I'ifPi tPfQre classified into case (d) increasing the value 
of ra x which classifys Pj into case (t). Then the line is adjusted with 
these points which are now classified into case (b) and tracking 
proceeds* 

Fi^*22 (c) rnd (d) illustrate that even if a port of the intensity 
profile is disturbed by noise or other lines* tracking does not terminate 
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there. In Fig. £2 (d), however, if the light intensity of the right side 
cf L changes across Lj ( the type of feature points might change across Li 
. Thus featvre points P Jt P^,... eight not be obtained and tracking might 
terminate at Pj . When tracking terminates, the line segment detection is 
applied at the extension of the line to see if another type of line 
segment is found. If found, we adjust the line equation and tracking 
proceeds. If not found, tracking finally terrainates at point Pj and the 
position of I| is adjusted with the line equation. The above procedure 
cften extends the line across other lines when it terminates temporarily 
at their crossing as in Fig-S (b) where tracking along G'M' crosses aany 
vertical lines. 
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4. EXPFHJHFNTAL RESULTS AWE COMMENTS 

To test the program, experiments are made with cubes and wedges 
having relatively uniform white surfaces placed on a black background. 
Ihe im&ce dissector camera , used as an input device, dissects the scene 
onto a 2COCO x 2O00C (octal) grid. In this experiment, one point for 
every 8 x £ block of frid elements is sampled* Thus, the scene is 
i^epresented by 1C24 x 1024 £rid points. Objects occupy only a part of 
the scene. In the typical scene, the rectangular area which includes the 
objects cf interest may consist of alout 400 x 400 points. This area is 
divided into blocks each of which is made of 64 x 64 points end stored in 
disk memory. When a lifht intensity at some point is required, a llock 
containing the point and adjacent blocks are stored in cere uteaory. The 
core memory is accessed for the input of the light intensity until a 
roint outside of those blocks is refererenced. 

Video input is at first converted into a 10 bit digital number which 
is an inverse linear raeasure of the li^ht intensity* It is again 
converted into 10 bit logarithmic measure. Some intensity level 

resolution is lost in the logarithmic conversion. In this experiment the 
light intensity is represented by a little less than 1C0 levels. The 
jnput dpta for e clear bright edge in the dark background is blurred due 
to some limitations (mostly defocusing). If the intensity change is a 
step function, there is a transient area in the input data about 1C 
points wide. Thus the resolution of the picture is regarded as 10 
points. The parameters u?f*d in line segment detection and tracking arc* 



PAGE 2C 



lased upcn this resolution* Features of the picture involving resolution 
of less thean 10 points ere not usually found* 

Some results are shewn in Fig.25* The difficulty or processing time 
of the recognition depends not only on the complexity of the object but 
also on the information extracted at each stage. In Fig. 23 (o), for 
example, boundary lines SJ» KS and QS are easily proposed as the 
extension of contour lines. On the other hand, it is not easy to find 
boundary lines Kt. or Lw in Fig.23 (c ). That is, after DK and HL are 
found, circular search is necessary at K and L respectively. Circular 
search is less reliable in finding a line segment, and more tioe 
consuming. Once the boundary lines are determined, all the internal 

lines are proposed in both eases. But tracking along VW in Fig.23 (c ) 
and FiJ in tfif.23 (c ) terminates in the middle* Then step (10) stated in 
section 1.1 is applied. This is the most time consuming process (about 
10 times more than the simple tracking process). 

Some examples of the result of a hierarchical program are shown in 
Jig.24. Hierarchical programs may look at the whole scene honogenicusly 
and pick up feature points. Lines are found v/ith those feature points 
obtained in the previous stage. It is very difficult to determine a 
priori the various thresholds for detection of feature points, line 
fitting and connection of lines. In this heterarchical program, it is 
possible to adjust various thresholds with the context of the information 
obtained previously. furthermore the algorithm itself can be modified 
case by case. (For instance, tracking al-orithm is changed depending on 
vhether the line is a boundary or internal.) The results of experiments 
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with moderately complex scenes are mostly satisfactory. Because of the 
riany checks for consistency of lines and vertices, the program has small 
probability of finding false lines. 

However i there are come limitations of this program at present. One 
of them is that todies may be missed in some cases. A simple example is 
shown in Fif-25* The bounCary lines th and EC ir. Fip.25 (a) are not 
proposed though the other contour lines and internal lines are found, 
because the resulting regions oro so 'neat' that no conceive vertices 
activate step (1J. In such a case when bodies are neatly stacked, it is 
necessary to search for boundary lines which start from some roints on 
the toundary line. In xig.25 (b) body E2 is not found. Tc find a body 
that is included in a face oi another body, it is necess&ry to search for 
line se^juents inside the region. Though these two kind of search (search 
clonr; the boundary line and search in the regicn) are required to find 
all the todies in the scenes as shown in Fig. 25, they are still more 
effective th#n the exhaustive search in the entire scene. Besides, it is 
simpler to interpret the scene when a line is found by those searches. 
Ihis procedure, however, is left to future work. 

The other limitation of the present program is, as stated in the 
introduction, that it is not always applicable to concave objects. 
Fig* 26 (a) shows a simple oxnaple. Line SU is found as an extension of 
line CB. If all the bodies are convex, line ED is interpreted as the 
boundary line as shown in Fig.26 (b). This does not hold for concave 
todies. In this program, line RD is regarded as a boundary line, and 

then line DE can be fouml by circular search at D. At this sta^e t however 
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EE should be interpreted as an internal line of the same body instead of 
the boundary line which separates the body into two* If DE ir> 
interpreted correctly, then line BD can be determined as an internal 
line- This procedure should also be inplemented in the present prpfracu 
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CONCWjSIOK 

A hetersrchical program to recognize polyhedra is presented. The 
program is based upon the strategy of recognizing objects step by step, 
at each tine making use of the previous results. The order of the lines 
to be detected is 1) contour lines (boundary of bodies and the 
background) , 2) boundary lines which are the boundary between two bodies, 
I) internal line.-; (intersection of two faces of the same body. Among 
touncary lines or among internal lines, the 'most plausible lines' are 
proposed at each sta*e and an atteopt is made to find the line. To find 
e lino, the range where a line segment may exist is proposed and it is 
detected in a suitable way for the proposed range. If a proper line 
sequent is found, the end of the line is determined by tracking along the 
line. Mien the line is determined, the program tries to understand the 
scene taking this line into consideration. Because lines are mostly 
proposed instead of found by exhaustive search in the scene, the program 
is relatively effective. Fesults of the experiaent using an image 
dissector are satisfactory for scenes including a few blocks and wedges. 
Although the present program has lioitations, some of them may be 
overcome by developments proposed here for future work. 
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Fig. 1. Example of Scene 
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Fig. 3, Examples of concave boundary lines 




Fig, 4. Illustrates two extension lines at concave point P. 
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fig. 5. Examples of line configuration found by circular search. 




Fig. 6. Example of circular search for Internal lines. 
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Fig. 8. Illustrates the process after tracking 
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Fig. 9* Illustrated the procedure to find lines* 
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Fig. 10. Flow chart of contour finding. 




Fig. 11. Illustrates the definition of curvature 
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Fig. 12- Example of curvature, 
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(a) light Intensity level profile 




(b) Areas to compute F H at P 
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(c) F u (v) for (a) 



Fig. 13. Kxample of F (v) 
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Fig. 14- Typical profile of F (v) . 
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Fig. 15- Peak detection. 
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Fig, 16. Detection of feature points. 
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Fig. 17. Range of circular search. 




K represents a feature point 



Fig. 18. Illustrates difficulty in classification 
of feature points. 




Fig. 19- Successive line detection in circular search. 



Fig. 20. Exanple of successive circular search, 
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Fig, 21. Repeated circular search. 
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Fig. 23. Examples of Experiment. 
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(a.): Objects* (b,): Result of Hierarchical Program 
(c.); Result of this program 



Fig. 24. Examples of Comparison Between Hierarchical 
and Heterarchical Program. 





<*) 



(b> 



Fig. 26. Illustrates difficulty for concave body. 
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Fig. 25. Illustrates lack of cues. 



